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Method and Apparatus for Detecting the Location and 
Luminance Transition Range of Slant Image Edges 

By 

XIANGLIN WANG 
5 and 

YEONG-TAEG KIM 

Field of the Invention 

The present invention relates to image detail 
10 enhancement, and in particular, to detecting the location as 
well as the luminance transition range of slant image edges 
in digital images. 

Background of the Invention 

15 In digital image systems (such as digital TV systems) , 

in order to boost video quality, images are often enhanced 
in many different aspects, such as image details, image 
contrast, etc., before being displayed. For a digital 
image, the quality of edges in the image (i.e., image edges) 

20 are of great importance to the overall image quality. 

Therefore, during the enhancement processes, each image edge 
should be well preserved. In other words, image enhancement 
should not sacrifice image edge quality. Otherwise, the 
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overall visual quality of the image may be degraded even 
though the image is enhanced in certain aspects. 

An instance of such visual quality degradation is a 
5 zigzagged edge artifact due to conventional image detail 

enhancement. As the goal of image detail enhancement is to 
improve the image sharpness, high frequency image components 
that contain image details are extracted, enhanced and then 
added back to the original image. As a result, image 
10 details in the processed image become more obvious than 
those in the original image. However, some artifacts can 
also be introduced into image edges because of the 
enhancement . 

15 An example of the zigzagged edge artifact is described 

in conjunction with FIGS. 1A-B. FIG. 1A shows an original 
image edge 10, wherein each small square block 11 in the 
edge 10 represents one image pixel. The edge direction has 
a low angle relative to the horizontal direction. Along the 

20 horizontal direction across the edge, there is a long 

luminance transition range 12 from dark area to bright area 
or vice versa, as indicated in FIG. 1A. The luminance 
transition range 12 refers to the length of the luminance 
transitioning area of an edge either along the horizontal 
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direction or along the vertical direction across the edge. 
The boundary of the edge shown in FIG. 1A looks generally 
smooth even though the edge has a limited image resolution. 

5 A conventional image detail enhancement process is 

applied to the image edge 10 of FIG. 1A to generate the 
enhanced image 14 in FIG. IB. Because in an image detail 
enhancement process high frequency components are boosted, 
the luminance transition range 12 may become shorter (or 

10 sharper) . As can be seen in FIG. IB, the luminance 

transition range 12 along the horizontal direction has 
become much shorter relative to that in FIG. 1A. As a 
consequence, the edge boundary now includes zigzagged edge 
artifacts. The more the image is enhanced in the detail 

15 enhancement process, the more obvious this kind of artifact 
would be. As a result, even though the image in FIG. IB is 
enhanced, the quality of the image looks poor due to the 
degradation of edge quality. 

20 The problem shown in FIG. IB exists for most slant image 

edges. A slant image edge refers to an image edge whose 
direction is not exactly vertical or horizontal. Only when 
an image edge has exactly vertical or horizontal or 

precisely ±45°(i.e. +45° or. -45°) direction, it is immune to 
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the problem shown in FIG. IB. Otherwise, a slant image edge 
can develop zigzagged edge artifacts if it is enhanced 
substantially. The closer the slant image-edge direction is 
to horizontal or vertical direction, the easier it is for a 
5 slant image edge to develop zigzagged edge artifact when 
enhanced substantially and the more obvious the artifact 
would be. 

Therefore, there is a need for a method of detecting the 
10 location and the luminance transition range of slant image 
edges so that pixels belonging to a slant edge can be 
processed separately or differently from the other image 
areas to avoid possible edge artifacts. 

15 Brief Summary of the Invention 

The present invention addresses the above needs. In 
one embodiment, the present invention provides a method that 
can be used for detecting the location and luminance 
transition range of slant image edges in a digital image so 
20 that pixels belonging to each slant edge can be processed 
separately. In one example, the detection method is 
conducted on a pixel basis, wherein each pixel is checked 
together with its neighboring pixels inside a rectangular 
window centered with the current pixel. 
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Such a detection method includes three main processes, 
implemented as an Edge Region Detector, a Slant Edge Center 
Locator and a Luminance Transition Range Detector. In the 
5 Edge Region Detector, the variance value for the pixels 

inside said square/rectangular window is calculated- Based 
on the variance value, a current pixel can be classified as 
being in an edge region or in a non-edge region. If the 
current pixel is in a non-edge region, no further checking 
10 is needed. However, if the current pixel is in an edge 
region, then the Slant Edge Center Locator checks if the 
current pixel is a center pixel in a luminance transition 
range of a slant edge. 

15 In the Slant Edge Center Locator, the values of the 

current pixel and its neighboring pixels inside said 
rectangular window are used to determine if the selected 
pixel is the center pixel in a luminance transition range of 
a slant edge. More specifically, the value of each pixel 

20 inside the window is compared with the luminance mean value 
of all the pixels inside the window, and only the comparison 
results are used in the succeeding detection process. To 
facilitate the processing, such comparison results can be 
saved as binary pattern data for each pixel in the window 
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through a binary pattern data generator in the Slant Edge 
Center Locator. The binary pattern data essentially serve as 
a buffer for saving some intermediate results, and is 
therefore optional. However, using the binary pattern data 
5 helps reduce the complexity and improves the speed of the 
detection process at the expense of a little more memory. 

The binary pattern data for the current pixel and its 
e.g. eight immediate neighboring pixels are then used to 

10 determine whether the current pixel is a center pixel in a 
luminance transition range of a slant edge. If it is, then 
the Luminance Transition Range Detector detects the exact 
length of the luminance transition range of the slant edge 
by checking more binary pattern data inside the rectangular 

15 window. 

Through such a detection process, both the center 
position and the luminance transition range of slant image 
edge can be determined. These and other features, aspects 
20 and advantages of the present invention will become 

understood with reference t'o the following description, 
appended claims and accompanying drawings. 
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Brief Description of the Drawings 

FIG. 1A shows an example smooth-looking image edge 
before detail enhancement; 
5 FIG. IB shows the same edge in FIG. 1A after detail 

enhancement, wherein the edge becomes zigzagged due to 
enhancement; 

FIG. 2 shows an example block diagram of an embodiment 
of a detection system for detecting the center position and 
10 the luminance transition range of slant image edge, 
according to the present invention; 

FIG. 3 shows a diagram of pixels inside an example 
window centered with a current/selected pixel and its 
neighboring pixels, for the detection of slant image edge 
15 at the current pixel location; 

FIG. 4 shows an example flowchart of steps for 
processing in an embodiment of the Edge Region Detector of 
FIG. 2; 

FIG. 5A shows an example of image pixel data inside 
20 the window centered with a current pixel; 

FIG. 5B shows an example corresponding binary data 
generated from the pixel data shown in FIG. 5A; 
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FIG. 6 shows an example flowchart of the steps for 
processing in an embodiment- of the Slant Edge Center 
Locator of FIG . 2; and 

FIG. 7 shows an example flowchart of the steps for 
5 processing in an embodiment of the Luminance Transition 
Range Detector of FIG. 2. 

Detailed Description of the Invention 

The present invention addresses the above needs. In one 
10 embodiment, the present invention provides a method for 
detecting the location and luminance transition range of 
slant image edges in a digital image, so that pixels 
belonging to each slant edge can be processed 
separately/differently than other image pixels. 

15 As noted, in one implementation, the detection method is 

conducted on a pixel basis, wherein each pixel is checked 
together with its neighboring pixels inside a rectangular 
window centered with the current pixel. The variance value 
of the pixels inside the rectangular window centered with a 

20 current pixel is checked to determine if the current pixel 
is in an edge region or in a non-edge region. If the 
current pixel is in an edge region, then the value of each 
pixel inside the rectangular window is compared with the 
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mean value of the all the pixels inside the window. Only the 
comparison results are used in the succeeding detection 
process. To facilitate the processing, such comparison 
result at each pixel location can be saved as binary data 
5 corresponding to that pixel. Then using the binary data of 
the current pixel and its neighboring pixels, it is 
determined if the current pixel is a center pixel in a 
luminance transition range of a slant edge. If it is, then 
the exact luminance transition range is detected based on 
10 the binary data (binary pattern data) , as described below in 
more detail. 

Referring to the example block diagram in FIG. 2, a 
detection system 100 implementing the above method of the 

15 present invention includes three functional processing 

blocks, identified in FIG. 2 as an Edge Region Detector 110, 
a Slant Edge Center Locator 120 and a Luminance Transition 
Range Detector 130. In the Edge Region Detector 110, the 
variance value for the pixels inside said rectangular window 

20 is calculated. Based on the variance value, a current pixel 
can be classified as being in an edge region or in a non- 
edge region. If the current pixel is in a non-edge region, 
no further checking is needed and a next pixel is processed. 
However, if the current pixel is in an edge region, then in 
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the Slant Edge Center Locator 120, it is determined if the 
current pixel is a center pixel in a luminance transition 
range of a slant edge. 



5 In the example Slant Edge Center Locator 120 herein, the 

value of each pixel inside the rectangular window is 
compared with the mean value of the all the pixels inside 
the window. Only the comparison results are used in the 
succeeding detection process. Then using said binary pattern 

10 data, it is determined whether the current pixel is a center 
pixel in a luminance transition range of a slant edge. In 
one example, the binary pattern data at the current pixel 
location and its neighboring pixels' binary pattern data 
(e.g., eight immediate neighboring pixels' binary pattern 

15 data) , is used to determine if the current pixel is the 
center pixel in a luminance transition range of a slant 
edge. If it is, then the Luminance Transition Range 
Detector 130 detects the length of the luminance transition 
range of the slant edge by checking more binary data inside 

20 the rectangular window. 



Through such a detection process, both the center 
position and the luminance transition range of slant image 
edge can be determined. The input to the detection system 
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100 in Fig. 2 is a digital image f , and output of the 
detection system 100 provides the center position, as well 
as the luminance transition range, of slant image edges in 
the input image / . 

5 

The slant edge information output from the detection 
system 100 can be saved in e.g. a data structure and used by 
a corresponding application to provide special processing 
for slant edge pixels. For example, such slant edge 

10 information can be utilized in an image detail enhancement 
system, wherein depending on the relative position of a 
slant edge pixel in the luminance transition range, an 
appropriate level of suppression can be provided to the 
enhancement at that pixel location to prevent zigzagged edge 

15 artifact. Such slant edge information can also be used for 
other image processing applications wherein edge pixels need 
to be processed differently from non-edge pixels. 

In the following, the functionality of each of the three 
20 processing blocks/modules 110, 120 and 130 in the detection 
system 100 of FIG. 2 is explained in more detail in relation 
to FIG. 3. At the outset, it is worth noting that 
preferably the processing according the detection system 100 
is performed twice at every pixel location, one for checking 
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image edges whose direction is close to the horizontal 
direction and another for checking image edges whose 
direction is close to the vertical direction. The 
following, description is based on the case wherein the edge 
5 direction is close to the horizontal direction. However, 
similar steps are applicable to image edges whose direction 
is close to the vertical direction, by exchanging the 
processing of the rows and columns in the rectangular 
window. 

10 

FIG. 3 shows an example diagram of a rectangular 
window 300 including pixels. 310 (i.e., p) , wherein the 
window 300 is defined inside the original image /. In this 
example, the window 300 is centered on a current/selected 

15 pixel 320. Only the pixels inside the rectangular window 
300 are used for the detection of a slant image edge at the 
current pixel location. The rectangular window 300 has a 
dimension of W pixels along the horizontal direction and H 
pixels along the vertical direction, such thatZ is the 

20 total number of pixels 310 inside the rectangular window 

300 (i.e., L = W*H). In this example, both Hand Ware odd 
numbers. Indices i and j 'represent the row and column 

index for the corresponding pixel , wherein p tj denotes each 
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pixel 310 inside the window 300 , /, . denotes the luminance 
value of pixel p i} and each value b tJ denotes the 
corresponding binary pattern data. 

5 As shown in FIG. 3, detection according to the 

detection system 100 (FIG. 2) is based on neighboring 
pixels within the rectangular window centered with the 
current pixel 320 , designated as p 00 . The current pixel 

p 00 is represented as a circle with a cross therein. The 
10 hollow circles represent neighboring pixels/samples of the 
current pixel p 00 . Though eight immediate neighboring 

pixels are used in this example, as those skilled in the 
art will recognize, other number of neighboring pixels and 
at different positions relative to the current pixel p 00 
15 may also be used. 

To detect a slant edge in the window 300 whose 
direction is close to the horizontal direction, H takes a 
value of 3 and W takes a value larger than 3. As noted 
20 above, symmetrically, to detect a slant edge whose 

direction is close to the vertical direction, W takes a 
value of 3 and H takes a value larger than 3. 

13 
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FIG. 4 shows example steps for determining if a 
current pixel belongs to an edge region. Referring to the 
example steps in FIG. 4 in conjunction with the diagram of 
FIG. 3, to determine if a current pixel belongs to an edge 
region, the window 300 of pixels 310 is selected (step 
402) . In this example H= 3, indicating that 3 rows of 
image pixels are utilized , and W has a larger value than 3 
because it determines the maximum length of the luminance 
transition range that can be checked along horizontal 
direction. As such, in FIG. 3, W = 11. The selected 
values for W and H are examples only, and other values can 
also be selected as those skilled in the art will 
appreciate . 

As described, each pixel inside the window 300 is 
denoted as p tj . After selection of the window 300, the Edge 
Region Detector 110 in the detection system of FIG. 2, 
first checks whether the current pixel p 00 is in an edge 
region. To do so, a variance value a is calculated based 
on a plurality of pixels around the current pixel p 0Q in 
the rectangular window (step 404). The following is an 
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example relation for calculating the variance value a , 
wherein: 

w-\ 

L ;=-l,0,l •_ W-\ 
3 2 

wherein, l l} denotes the luminance value of pixel p u , m 

is the mean value of said plurality of pixels inside the 

rectangular window 300 and is defined according to the 

following example relation:. 

w-\ 

m =j Z 2X; (2) 

L — 1,0,1 = w-\ 

J ' 2 

The variance value a is then checked against a 
predetermined threshold T r wherein T > 0 (step 406). If 
a is smaller than T , then the current pixel p 00 is 
considered to be in a non-edge region. In that case, no 
further checking is needed at the current pixel p 00 
location and the process moves to the next pixel (step 408). 

However, if the variance value a is not less than the 
threshold T , the current pixel p 00 is considered as being 

in an edge region and the Slant Edge Center Locator 120 
(FIG. 2) determines if the current pixel is a center pixel 
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in a luminance transition range of a slant edge. In the 
Slant Edge Center Locator 120, the value of each pixel 
inside the rectangular window 300 is compared with the mean 
value of all the pixels inside the window 300. Only the 
5 comparison results are used in the succeeding detection 
process. As noted, to facilitate the processing, such 
comparison result at each pixel location can be saved as 
binary data corresponding to that pixel, as shown by the 
example diagrams in FIGS. 5A-B, through a binary pattern 
10 data generator in the Slant Edge Center Locator 120. FIG. 
5A shows an example of image pixel data inside the window 
300 centered with the current pixel p Q0 , and FIG. 5B shows 

an example corresponding binary data 500 generated from the 
pixel data shown in FIG. 5A. 

15 

In the description herein, the windows in FIGS. 3 and 
5A-5B, are of the same dimensions and the values therein are 
indexed in rows and columns in the same manner as described 
in relation to FIG. 3. Now also referring to the example 
20 steps of FIG. 6, in the Slant Edge Center Locator 120 the 
luminance value l i} of each pixel inside the rectangular 
window 300 is compared with the mean value m (step 600), 
whereby the corresponding binary data b §J can be generated 
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according to the example relation: 

f 0 if/. ,. <m 
' J [ 1 if Igj > m 

In the example shown in FIG. 5A, pixel luminance is in 
5 a range of [ 0, 255 ] . A value of 7 /y =255 represents the 

brightest luminance level and a value of 1^=0 represents 

the darkest luminance level. Using the above relations, 
the mean value m is calculated to be 123 for the pixel 
values in FIG. 5A, wherein the diagram in FIG. 5B shows 
10 that pattern 500 of binary data 510 generated from the 
pixel data shown in FIG. 5A according to relation (3) . 

Such binary data 500 essentially serve as a buffer for 
saving some intermediate results in the process and is 

15 therefore optional. However, using the binary data helps 
reduce the complexity and improve the speed of the 
detection process at the expense of a little more memory. 
To simplify the description of the present invention, the 
binary data 500 are used in the following. However, as 

20 noted, the binary data 500 need not necessarily be 

generated in the process because the relationship between 
the value of each pixel in the rectangular window 300 and 
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the luminance mean value of all the pixels inside the 
window 300 can also be obtained on the fly. 

Referring back to the Slant Edge Center Locator 120 
5 of FIG. 2, the binary data values in the pattern 500 at the 
location of pixel p 00 and its eight immediate neighboring 
binary data values are checked to determine whether the 
current pixel p Q0 is the center pixel in a luminance 
transition range of a slant image edge. The binary value 
10 corresponding to the location of the current pixel p 00 is 

b 00 , and the binary values corresponding to the eight 
neighboring pixels of the current pixel /? 0>0 , are b i j , i, j 
= -1, 0, 2, excluding b 00 itself. As such, the closest four 
neighboring binary pattern data, 6_ 10 , b x o , b 0 _ { and b 0} , are 
15 checked first (step 602) . If b_ l0 and b l0 have different 

values, and b Q _ { and b 0l also have different values, then the 
current pixel p Q0 is considered as a candidate for being 

the center pixel in a luminance transition range of a slant 
edge. These conditions can be expressed according to the 
20 example relation: 

(*-i,o-\o)*(Vi-M*° < 4 > 
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If condition (4) is not satisfied (i.e., it is false), 
then the current pixel p 00 is not a center pixel in the 

luminance transition range of a slant image edge, and no 
further checking is needed at the current pixel location, 
5 so that the process moves to the next position (step 606) . 
Otherwise, if condition (4) is satisfied (i.e., true), then 
the other four binary pattern data, b_ x _ x , b_ xx , b x _ x and b xx , 

are checked (step 604). If b_ x _ x and b_ xx both have the same 

value as b_ x 0 , and also b x _ x and b x x both have the same value 

10 as b XQ , then the current pixel p Q0 is considered as a 

center pixel in a luminance transition range of a slant 
edge. In addition, it can be assumed that the luminance 
transition range centered with the current pixel is at 
least 3 pixels wide. These above conditions can be 
15 expressed according to the example relation: 

/=-i,i y=-i,i 

If condition (5) is not satisfied (i.e., it is false), 
then the current pixel p 00 is not a center pixel in the 

20 luminance transition range of a slant image edge, and no 
further checking is needed at the current pixel location, 
so that the process moves to the next position (step 606) . 

19 



SAM2.0027 

R:\M-Z\SAM2\SAM2.PAU.27\03-FINAL-APP. 1 0- 1 6-03.doc 

Otherwise, if condition (5) is satisfied (i.e., true), 
then as shown by the example steps in FIG. 7, the Luminance 
Transition Range Detector 130 in FIG. 2 detects the length 
5 of the luminance transition range with more binary pattern 
data involved in the checking process. In the Luminance 
Transition Range Detector 130, the detection of the 
luminance transition range starts from columns 2 and -2 
around the current pixel p 0Q in the binary pattern 500 such 

10 as in FIG. 5B, and goes left and right simultaneously (step 
700) . Each time two more columns of the binary pattern 
data are included, one from the left side and one from the 
right side of the current pixel. 

15 For example, initially the binary values b_ x 2 , b 0 _ 2 and 

6,_ 2 from column -2, and the binary values b_ X2 , b oa and b l2 
from column 2 are included in the process. If b_ x _ 2 , b 0 _ 2 and 
b x _ 2 each has the same value as , 6 0 _, and , 
respectively, and b_ x2 , b 02 and b X2 each has the same value 

20 as b_ xx , b ox and respectively, then the pixel 

corresponding to b 0 _ 2 and the pixel corresponding to b 02 can 
also be considered as being in the luminance transition 
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o 

range of the edge, so that it can be assumed that the 
luminance transition range is at least 5 pixels wide. 

Using the same method, column -3 and column 3 of the 
binary pattern data can also be checked. If data in column 
-3 are the same at those in column -2, and meanwhile data in 
column 3 are the same at those in column 2, then it can be 
assumed that the luminance transition range is at least 7 
pixels wide. 

As such, in general, after column k-l and column -(k-l) 
are checked, wherein the luminance transition range is 
assumed to be at least 2*(A:-1) + 1 pixels wide, then column k 

W -\ 

and column -k can be checked, where 2<k< . For 

2 

example, to check the binary pattern data in column k and 
column -k (step 702), the following example condition 
according to the above description, is utilized: 



If condition (6) is satisfied (i.e., true), then column 
k and column -k have the same data as that in column k-l 
and column -(k-\), respectively, and it can be assumed that 




(6) 



/= -1,0,1 
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the luminance transition range is at least 2*&+l pixels 
wide. Then, so long as there is another column to consider 
(step 704), the process is extended to the additional 
columns as noted above (step 706) . 



Therefore, such a* checking process can continue until 
either condition (6) is not true, wherein the process 
proceeds to step 710, or until all the binary pattern data 
in the rectangular window have been checked according to 
10 steps 702, 704 and 706. For example, assuming that the 
checking process has reached column k and column -k , if 
condition (6) is false, then the detection process stops for 
the current pixel p 00 location and the luminance 

transition range is considered as 2*(£-l) + l pixels wide 
15 (step 710). However, if condition (6) is true but k equals 
W-l 

to — - — (step 704), indicating that all the binary data 

inside the rectangular window have been checked, the 
detection process stops for the current pixel p 00 location 

and the luminance transition range is considered as 
20 (2*£ + l) = ^ pixels wide (step 708). 

In the above process, detecting the luminance transition 
range for a slant edge is conducted according to the 
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condition in relation (6), wherein the detection starts 
with k = 2 (step 700). Each time the binary pattern data in 
column k and column -k are compared with that in column 
k-l and column -(k-1), respectively. If they are the same, 
W -I 

5 and k < (step 704), then k is increased by 1 (step 706) 

and the same checking process continues. If they are the 
W -\ 

same, and k = , then the checking terminates for the 

2 

current pixel p 0Q location and the luminance transition 

range is considered as W pixels wide centered with the 
10 current pixel p Q0 (step 708) . 



If the binary pattern data in column k and column -k 
are not the same as that in column k-l and column -(k-l), 
respectively, then the checking process terminates for the 
15 current pixel p Q0 location and the luminance transition 

range is considered as 2*(£-l) + l pixels wide, centered with 
the current pixel (710) . 

As such, the example detection system 100 (FIG. 2) and 
20 method according to the present invention, described herein, 
determine both the center position and the luminance 
transition range of slant image edge. This allows separate 
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or different processing of the detected pixels from other 
image areas. For example, when such detection results are 
used in an image detail enhancement process, the quality of 
image edges, especially slant edges, can be preserved while 
5 the other image areas can still be effectively enhanced. 
Such a detection method is useful not only in image detail 
enhancement, but also it can be useful in image processing 
techniques wherein image edges must be processed separately 
or differently from the other image areas. 

10 

While this invention is susceptible of embodiments in 
many different forms, there are shown in the drawings and 
will herein be described in detail, preferred embodiments of 
the invention with the understanding that the present 

15 disclosure is to be considered as an exemplification of the 
principles of the invention, and is not intended to limit the 
broad aspects of the invention to the embodiments 
illustrated. The aforementioned detection system according 
to the present invention, can be implemented in many ways, 

20 such as program instructions for execution by a processor, 
as logic circuits, as ASIC, as firmware, etc., as is known 
to those skilled in the art. Therefore, the present 
invention is not limited to the example embodiments 
described herein. 
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The present invention has been described in 
considerable detail with reference to certain preferred 
versions thereof; however, other versions are possible. 
5 Therefore, the spirit and scope of the appended claims 

should not be limited to the description of the preferred 
versions contained herein. 
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